-
Notifications
You must be signed in to change notification settings - Fork 1.8k
out_azure_blob: added buffering to azure blob #10263
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
out_azure_blob: added buffering to azure blob #10263
Conversation
|
docs PR # fluent/fluent-bit-docs#1632 |
|
We have been running this version in many clusters for the past 24 hours and it's working great |
dc7a6c8 to
f5b094a
Compare
|
the number of commits needs to be reduced and just grouped to what is needed, keeping a clean history is very important for long term maintenance: you can use the guidelines as a reference: https://github.com/fluent/fluent-bit/blob/master/CONTRIBUTING.md#commit-changes |
Signed-off-by: Tanmaya Panda <[email protected]>
4a4fea1 to
44e8fa3
Compare
|
@edsiper as per your comments, cleaned up the commit history. |
|
thank you! |

This pull request introduces significant enhancements to the Azure Blob plugin, focusing on adding buffering capabilities and improving URI handling.
Buffering Enhancements
buffering_enabled,buffer_dir,store_dir_limit_size, andcurrent_buffer_sizein theflb_azure_blobstruct. These changes enable the plugin to buffer data before uploading to Azure Blob Storage.appendblobblob type, as it is incompatible. An error is logged if this configuration is detected.URI Handling Improvements
azb_block_blob_uriandazb_block_blob_uri_commitfunctions to include a newrandom_strparameter for generating more unique URIs for block blobs. This ensures better handling of concurrent uploads.Enter
[N/A]in the box, if an item is not applicable to your change.Testing
Before we can approve your change; please submit the following in a comment:
If this is a change to packaging of containers or native binaries then please confirm it works for all targets.
ok-package-testlabel to test for all targets (requires maintainer to do).Documentation
Backporting
Fluent Bit is licensed under Apache 2.0, by submitting this pull request I understand that this code will be released under the terms of that license.